Using visual attention estimation on videos for automated prediction of autism spectrum disorder and symptom severity in preschool children.

Atypical visual attention in individuals with autism spectrum disorders (ASD) has been utilised as a unique diagnosis criterion in previous research. This paper presents a novel approach to the automatic and quantitative screening of ASD as well as symptom severity prediction in preschool children. We develop a novel computational pipeline that extracts learned features from a dynamic visual stimulus to classify ASD children and predict the level of ASD-related symptoms. Experimental results demonstrate promising performance that is superior to using handcrafted features and machine learning algorithms, in terms of evaluation metrics used in diagnostic tests. Using a leave-one-out cross-validation approach, we obtained an accuracy of 94.59%, a sensitivity of 100%, a specificity of 76.47% and an area under the receiver operating characteristic curve (AUC) of 96% for ASD classification. In addition, we obtained an accuracy of 94.74%, a sensitivity of 87.50%, a specificity of 100% and an AUC of 99% for ASD symptom severity prediction.

Analysis of Wildfire Visualization Systems for Research and Training: Are They up for the Challenge of the Current State of Wildfires?

Wildfires affect many regions across the world. The accelerated progression of global warming has amplified their frequency and scale, deepening their impact on human life, the economy, and the environment. The temperature rise has been driving wildfires to behave unpredictably compared to those previously observed, challenging researchers and fire management agencies to understand the factors behind this behavioral change. Furthermore, this change has rendered fire personnel training outdated and lost its ability to adequately prepare personnel to respond to these new fires. Immersive visualization can play a key role in tackling the growing issue of wildfires. Therefore, this survey reviews various studies that use immersive and non-immersive data visualization techniques to depict wildfire behavior and train first responders and planners. This paper identifies the most useful characteristics of these systems. While these studies support knowledge creation for certain situations, there is still scope to comprehensively improve immersive systems to address the unforeseen dynamics of wildfires.

Eye-tracking correlates of response to joint attention in preschool children with autism spectrum disorder.

BACKGROUND: A number of differences in joint attention behaviour between children with autism spectrum disorder (ASD) and typically developing (TD) individuals have previously been documented. METHOD: We use eye-tracking technology to assess response to joint attention (RJA) behaviours in 77 children aged 31 to 73 months. We conducted a repeated-measures analysis of variance to identify differences between groups. In addition, we analysed correlations between eye-tracking and clinical measures using Spearman's correlation. RESULTS: The children diagnosed with ASD were less likely to follow gaze compared to TD children. Children with ASD were less accurate at gaze following when only eye gaze information was available, compared to when eye gaze with head movement was observed. Higher accuracy gaze-following profiles were associated with better early cognition and more adaptive behaviours in children with ASD. Less accurate gaze-following profiles were associated with more severe ASD symptomatology. CONCLUSION: There are differences in RJA behaviours between ASD and TD preschool children. Several eye-tracking measures of RJA behaviours in preschool children were found to be associated with clinical measures for ASD diagnosis. This study also highlights the construct validity of using eye-tracking measures as potential biomarkers in the assessment and diagnosis of ASD in preschool children.

Human-robot creative interactions: Exploring creativity in artificial agents using a storytelling game.

Creativity in social robots requires further attention in the interdisciplinary field of human-robot interaction (HRI). This study investigates the hypothesized connection between the perceived creative agency and the animacy of social robots. The goal of this work is to assess the relevance of robot movements in the attribution of creativity to robots. The results of this work inform the design of future human-robot creative interactions (HRCI). The study uses a storytelling game based on visual imagery inspired by the game "Story Cubes" to explore the perceived creative agency of social robots. This game is used to tell a classic story for children with an alternative ending. A 2 × 2 experiment was designed to compare two conditions: the robot telling the original version of the story and the robot plot twisting the end of the story. A Robotis Mini humanoid robot was used for the experiment, and we adapted the Short Scale of Creative Self (SSCS) to measure perceived creative agency in robots. We also used the Godspeed scale to explore different attributes of social robots in this setting. We did not obtain significant main effects of the robot movements or the story in the participants' scores. However, we identified significant main effects of the robot movements in features of animacy, likeability, and perceived safety. This initial work encourages further studies experimenting with different robot embodiment and movements to evaluate the perceived creative agency in robots and inform the design of future robots that participate in creative interactions.

Explainable AI and Reinforcement Learning-A Systematic Review of Current Approaches and Trends.

Research into Explainable Artificial Intelligence (XAI) has been increasing in recent years as a response to the need for increased transparency and trust in AI. This is particularly important as AI is used in sensitive domains with societal, ethical, and safety implications. Work in XAI has primarily focused on Machine Learning (ML) for classification, decision, or action, with detailed systematic reviews already undertaken. This review looks to explore current approaches and limitations for XAI in the area of Reinforcement Learning (RL). From 520 search results, 25 studies (including 5 snowball sampled) are reviewed, highlighting visualization, query-based explanations, policy summarization, human-in-the-loop collaboration, and verification as trends in this area. Limitations in the studies are presented, particularly a lack of user studies, and the prevalence of toy-examples and difficulties providing understandable explanations. Areas for future study are identified, including immersive visualization, and symbolic representation.

Generative Adversarial Networks-Enabled Human-Artificial Intelligence Collaborative Applications for Creative and Design Industries: A Systematic Review of Current Approaches and Trends.

The future of work and workplace is very much in flux. A vast amount has been written about artificial intelligence (AI) and its impact on work, with much of it focused on automation and its impact in terms of potential job losses. This review will address one area where AI is being added to creative and design practitioners' toolbox to enhance their creativity, productivity, and design horizons. A designer's primary purpose is to create, or generate, the most optimal artifact or prototype, given a set of constraints. We have seen AI encroaching into this space with the advent of generative networks and generative adversarial networks (GANs) in particular. This area has become one of the most active research fields in machine learning over the past number of years, and a number of these techniques, particularly those around plausible image generation, have garnered considerable media attention. We will look beyond automatic techniques and solutions and see how GANs are being incorporated into user pipelines for design practitioners. A systematic review of publications indexed on ScienceDirect, SpringerLink, Web of Science, Scopus, IEEExplore, and ACM DigitalLibrary was conducted from 2015 to 2020. Results are reported according to PRISMA statement. From 317 search results, 34 studies (including two snowball sampled) are reviewed, highlighting key trends in this area. The studies' limitations are presented, particularly a lack of user studies and the prevalence of toy-examples or implementations that are unlikely to scale. Areas for future study are also identified.

A stochastic model of jaguar abundance in the Peruvian Amazon under climate variation scenarios.

The jaguar (Panthera onca) is the dominant predator in Central and South America, but is now considered near-threatened. Estimating jaguar population size is difficult, due to uncertainty in the underlying dynamical processes as well as highly variable and sparse data. We develop a stochastic temporal model of jaguar abundance in the Peruvian Amazon, taking into account prey availability, under various climate change scenarios. The model is calibrated against existing data sets and an elicitation study in Pacaya Samiria. In order to account for uncertainty and variability, we construct a population of models over four key parameters, namely three scaling parameters for aquatic, small land, and large land animals and a hunting index. We then use this population of models to construct probabilistic evaluations of jaguar populations under various climate change scenarios characterized by increasingly severe flood and drought events and discuss the implications on jaguar numbers. Results imply that jaguar populations exhibit some robustness to extreme drought and flood, but that repeated exposure to these events over short periods can result in rapid decline. However, jaguar numbers could return to stability-albeit at lower numbers-if there are periods of benign climate patterns and other relevant factors are conducive.

Computer vision in autism spectrum disorder research: a systematic review of published studies from 2009 to 2019.

The current state of computer vision methods applied to autism spectrum disorder (ASD) research has not been well established. Increasing evidence suggests that computer vision techniques have a strong impact on autism research. The primary objective of this systematic review is to examine how computer vision analysis has been useful in ASD diagnosis, therapy and autism research in general. A systematic review of publications indexed on PubMed, IEEE Xplore and ACM Digital Library was conducted from 2009 to 2019. Search terms included ['autis*' AND ('computer vision' OR 'behavio* imaging' OR 'behavio* analysis' OR 'affective computing')]. Results are reported according to PRISMA statement. A total of 94 studies are included in the analysis. Eligible papers are categorised based on the potential biological/behavioural markers quantified in each study. Then, different computer vision approaches that were employed in the included papers are described. Different publicly available datasets are also reviewed in order to rapidly familiarise researchers with datasets applicable to their field and to accelerate both new behavioural and technological work on autism research. Finally, future research directions are outlined. The findings in this review suggest that computer vision analysis is useful for the quantification of behavioural/biological markers which can further lead to a more objective analysis in autism research.

Using virtual reality to estimate aesthetic values of coral reefs.

Aesthetic value, or beauty, is important to the relationship between humans and natural environments and is, therefore, a fundamental socio-economic attribute of conservation alongside other ecosystem services. However, beauty is difficult to quantify and is not estimated well using traditional approaches to monitoring coral-reef aesthetics. To improve the estimation of ecosystem aesthetic values, we developed and implemented a novel framework used to quantify features of coral-reef aesthetics based on people's perceptions of beauty. Three observer groups with different experience to reef environments (Marine Scientist, Experienced Diver and Citizen) were virtually immersed in Australian's Great Barrier Reef (GBR) using 360° images. Perceptions of beauty and observations were used to assess the importance of eight potential attributes of reef-aesthetic value. Among these, heterogeneity, defined by structural complexity and colour diversity, was positively associated with coral-reef-aesthetic values. There were no group-level differences in the way the observer groups perceived reef aesthetics suggesting that past experiences with coral reefs do not necessarily influence the perception of beauty by the observer. The framework developed here provides a generic tool to help identify indicators of aesthetic value applicable to a wide variety of natural systems. The ability to estimate aesthetic values robustly adds an important dimension to the holistic conservation of the GBR, coral reefs worldwide and other natural ecosystems.

An image-guided radiotherapy decision support framework incorporating a Bayesian network and visualization tool.

PURPOSE: To describe a Bayesian network (BN) and complementary visualization tool that aim to support decision-making during online cone-beam computed tomography (CBCT)-based image-guided radiotherapy (IGRT) for prostate cancer patients. METHODS: The BN was created to represent relationships between observed prostate, proximal seminal vesicle (PSV), bladder and rectum volume variations, an image feature alignment score (FASTV_OAR ), delivered dose, and treatment plan compliance (TPC). Variables influencing tumor volume (TV) targeting accuracy such as intrafraction motion, and contouring and couch shift errors were also represented. A score of overall TPC (FASglobal ) and factors such as image quality were used to inform the BN output node providing advice about proceeding with treatment. The BN was quantified using conditional probabilities generated from published studies, FASTV_OAR/global modeling, and a survey of IGRT decision-making practices. A new IGRT visualization tool (IGRTREV ), in the form of Mollweide projection plots, was developed to provide a global summary of residual errors after online CBCT-planning CT registration. Sensitivity and scenario analyses were undertaken to evaluate the performance of the BN and the relative influence of the network variables on TPC and the decision to proceed with treatment. The IGRTREV plots were evaluated in conjunction with the BN scenario testing, using additional test data generated from retrospective CBCT-planning CT soft-tissue registrations for 13/36 patients whose data were used in the FASTV_OAR/global modeling. RESULTS: Modeling of the TV targeting errors resulted in a very low probability of corrected distances between the CBCT and planning CT prostate or PSV volumes being within their thresholds. Strength of influence evaluation with and without the BN TV targeting error nodes indicated that rectum- and bladder-related network variables had the highest relative importance. When the TV targeting error nodes were excluded from the BN, TPC was sensitive to observed PSV and rectum variations while the decision to treat was sensitive to observed prostate and PSV variations. When root nodes were set so the PSV and rectum variations exceeded thresholds, the probability of low TPC increased to 40%. Prostate and PSV variations exceeding thresholds increased the likelihood of repositioning or repeating patient preparation to 43%. Scenario testing using the test data from 13 patients, demonstrated two cases where the BN provided increased high TPC probabilities, despite some of the prostate and PSV volume variation metrics not being within tolerance. The IGRTREV tool was effective in highlighting and quantifying where TV and OAR variations occurred, supporting the BN recommendation to reposition the patient or repeat their bladder and bowel preparation. In another case, the IGRTREV tool was also effective in highlighting where PSV volume variation significantly exceeded tolerance when the BN had indicated to proceed with treatment. CONCLUSIONS: This study has demonstrated that both the BN and IGRTREV plots are effective tools for inclusion in a decision support system for online CBCT-based IGRT for prostate cancer patients. Alternate approaches to modeling TV targeting errors need to be explored as well as extension of the BN to support offline IGRT decisions related to adaptive radiotherapy.

A feature alignment score for online cone-beam CT-based image-guided radiotherapy for prostate cancer.

PURPOSE: To develop a method for scoring online cone-beam CT (CBCT)-to-planning CT image feature alignment to inform prostate image-guided radiotherapy (IGRT) decision-making. The feasibility of incorporating volume variation metric thresholds predictive of delivering planned dose into weighted functions, was investigated. METHODS: Radiation therapists and radiation oncologists participated in workshops where they reviewed prostate CBCT-IGRT case examples and completed a paper-based survey of image feature matching practices. For 36 prostate cancer patients, one daily CBCT was retrospectively contoured then registered with their plan to simulate delivered dose if (a) no online setup corrections and (b) online image alignment and setup corrections, were performed. Survey results were used to select variables for inclusion in classification and regression tree (CART) and boosted regression trees (BRT) modeling of volume variation metric thresholds predictive of delivering planned dose to the prostate, proximal seminal vesicles (PSV), bladder, and rectum. Weighted functions incorporating the CART and BRT results were used to calculate a score of individual tumor and organ at risk image feature alignment (FASTV_OAR ). Scaled and weighted FASTV_OAR were then used to calculate a score of overall treatment compliance (FASglobal ) for a given CBCT-planning CT registration. The FASTV_OAR were assessed for sensitivity, specificity, and predictive power. FASglobal thresholds indicative of high, medium, or low overall treatment plan compliance were determined using coefficients from multiple linear regression analysis. RESULTS: Thirty-two participants completed the prostate CBCT-IGRT survey. While responses demonstrated consensus of practice for preferential ranking of planning CT and CBCT match features in the presence of deformation and rotation, variation existed in the specified thresholds for observed volume differences requiring patient repositioning or repeat bladder and bowel preparation. The CART and BRT modeling indicated that for a given registration, a Dice similarity coefficient >0.80 and >0.60 for the prostate and PSV, respectively, and a maximum Hausdorff distance <8.0 mm for both structures were predictive of delivered dose ± 5% of planned dose. A normalized volume difference <1.0 and a CBCT anterior rectum wall >1.0 mm anterior to the planning CT anterior rectum wall were predictive of delivered dose >5% of planned rectum dose. A normalized volume difference <0.88, and a CBCT bladder wall >13.5 mm inferior and >5.0 mm posterior to the planning CT bladder were predictive of delivered dose >5% of planned bladder dose. A FASTV_OAR >0 is indicative of delivery of planned dose. For calculated FASTV_OAR for the prostate, PSV, bladder, and rectum using test data, sensitivity was 0.56, 0.75, 0.89, and 1.00, respectively; specificity 0.90, 0.94, 0.59, and 1.00, respectively; positive predictive power 0.90, 0.86, 0.53, and 1.00, respectively; and negative predictive power 0.56, 0.89, 0.91, and 1.00, respectively. Thresholds for the calculated FASglobal of were low <60, medium 60-80, and high >80, with a 27% misclassification rate for the test data. CONCLUSIONS: A FASglobal incorporating nested FASTV_OAR and volume variation metric thresholds predictive of treatment plan compliance was developed, offering an alternative to pretreatment dose calculations to assess treatment delivery accuracy.

Cloud based toolbox for image analysis, processing and reconstruction tasks.

This chapter describes a novel way of carrying out image analysis, reconstruction and processing tasks using cloud based service provided on the Australian National eResearch Collaboration Tools and Resources (NeCTAR) infrastructure. The toolbox allows users free access to a wide range of useful blocks of functionalities (imaging functions) that can be connected together in workflows allowing creation of even more complex algorithms that can be re-run on different data sets, shared with others or additionally adjusted. The functions given are in the area of cellular imaging, advanced X-ray image analysis, computed tomography and 3D medical imaging and visualisation. The service is currently available on the website www.cloudimaging.net.au .